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ABSTRACT _ • 

_ Because the Navy n^eds tools to assess the personnel 
implications of proposed. iquipmerit arid system desigris^ a literature 
search^ was conducted in 1978 to determine how hardware, des igri 
engineers perceive the relationships between system design 
characteristics and the skills of the^system operator and maintenance 
personnel. Recent studies conducted by the human rescfurces research 
community were reviewed, especially research on the design process 

and skill information needs of designers , job performance , the 

analysis and measurement of skills , and the presentation of human 
resources information . I t was found that engineers were re spo 
human resources constraints when such constraints w presented as 
design requirements, but that they consi^ hu^nan 
resources data as less important than other aspects of system design. 
This publication presents the literature review. and recommends that, 
in defining the techniques needed to cbmihuhicate human resources data 
to design engineers, research be directed toward developing a bettex: 
understanding of how engineers perceive the relationship between 
design characteristic's and resulting skill implications, and that 
specific operational definitions of skills applicable to Navy ratings 
and pay grades be developed in- terms and formats readily 
understandable to and directly usable by hardware designers. A 
46-it^m bibliography is provided . ' (ESR) 
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FOREWORD , ' 

This effort was conducted under subproject -Z\l I70"PiSj.05^ Reducing Maripdwer Costs 
/Trhrough Better System Design, ^nd was sponsored By \he Deputy Chief of Naval 
Oper.ations (Manpower, Personnel, and Training) (OP-OI). The objective of the subproject 
is to develop techniques ^or analyzing hardware/software/personnel trade-offs at all 
vStages of system design. The objective of the Hteratafe review reported here was to 
determine ho^ hardware design engineers perceive the relationships between system 
design characteristics and skills of system operator .andvmaintenahce personnel. . 

The literature review was conducted in 1978.and subsequently used to. prepare a draft 
version of an engineer's guide titled "Designing for Human Skills in Navy Electronic 
Systems." Further development of this guide was abandoned in favor of a related guide 
study, resulting in publicati-on of Afi Engineer's Guide to We Use of Human ^Resources in 
Electronic Systems Design (NPRDC TN 79-8) and ah evalilatibri of that guide (NPRDC SR 
81^3). The literature review is being documented at this time so that it can be distributed 
to the research community. ^ \ _ 

the contracting officer's techical representative was Mrl Ernest A. Koehler. - 

RICHARD C. SORENSON 
Director of Programs 



' . ■ ; ^SUMMARY 

' '; * - ■ 

Problem 

•-. ■ \ ' . 1 - - . 

As new man-machine systems, are .developed for the Navy^; the demand for Wghly 

qualified and skilled personnel to operate and rriaintain them increases- This increasing 

derri'ahd requires more efficient utilization of persbhnel at a time when the Navy's supply 

of rriahpbwer is limited, especially at the journeyman skill levels required for many system 

operator ^ and technician 'ratings. Conseijuehtly, the requirements for such skilled 

personnel rriust be .carefully considered in- weighing the assets and liabilities of proposed 

. equipmeht and .system designs. Since cbrripetihg designs are normally compared by the 

hardware developmeht community during trade-off studies^ tools are needed to assess the 

personnel implications of designs being cbhsidered; ^ ' 

Objectiv e ' ' • ' " , 

The objective of this effort was to determine how Hardware design engineers pef ceive 

the relationships bet>ween system design characteristics and skills of system operator and 

e ■ ; - 

maintenance personnel. • ^ • % : 

• Approach . • 

Recent studies conducted by the hurrtan resources research community were review- ' 
ed. Specral attention was directed toward research conducted on (1) the design process 
and skill linformation needs of designers, (2) job perforraance, (3) the analysis' and 
. measurement of skills^ and ft) the presentation of human resources informa'tion. 
Findings ' ^ 

I. Engineers were , responsive to:human resources constraints when such constraints 
were presented as design reqUirerhehts.- ' . ' 

: \ . . . " - -i - - . ' • - - • 

; ;2. The engineer's design is ihfiuehced by the amount \of human resoljrtes data 
avaliable and when, in the design cycle^ it is presented. 

3. , Engineers responded more positively to humari resources requirements when 
; th^y were imposed as quantity constraints rather than skill level constraints. 



^ U. the trade-off pfdcess iri systems design depends on the personal styles and^ 
jydgrh^ntsx)f the ertgiiieers.* ' > , 

' 3* " En^ine^rs consistently ranked Raman resources data as less, important than other 
aspects of system design. / \ * \ • ^' / ; . , - 

.; f ■' _ _^ _____ _ _ _ ^__ " _'_"__ J _!l^_ _ _ . _ _' . J, ' 

6i ,The desigii engineers' lack of concern lor human resources da'tct derives fDartly 
from their educcttion ancl experience^ and fi^rtly from the Iriappropriateriess' of the data 
itself ^rid its presentation. ' ^ , / * ' 

Concrusiohs . ' * . V ' * 

1. Although the rnagriitude of th^ problem of cbrhrriurii eating human resources data . 
to design engihe^s is wellTecoghized^ its solution is hot cjearly definable. \ * 

2. The" types of data' required for cbitirriuhicatirig* human resource^ ihfbrmatibh to 
engineers ar§ hat readily identifiable. - ^ 
Recommendatiohs * . ' . 

1. In defining the techniques needed to communicate human resources data to 

" ' _.____._____._.__".__ f , _ _ _ ■ _ '* j» : . . , 

d^^ign engineers, research should be direote'd toward developing a better understaHding of 

_ _ >, ;.__'_..''_.__ ^ . _ _V . ' . - - - 

how engineers perceive the relationship between design characteristics and resulting skills • 
implications. * * ^ " : ' 

2. Specific operational definitions of skills applicable to Navy ratings, and pay 

grades operating and maintaining hardware systems should be 4eveloped. Sbch operational 

«__• -- -. ^ - ^ - v * 

<lefinitions should Be in terms and formats readily understandable to and directly usable by 

the hardware designers. 
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^ INTRODUGTION. 

PF^biem and Background ^ 

: Manpower has become the most expensive cbmponerit the Navy's inyentory.^^^^^^ A^^^^ 
.newer, more advanced systems are developed^ even more highly qualified and skilled 
personnel will t^e needed. . As with any limited resource, increasing demands will 
necessitate rnore^ efficient utilization, adding two considerations to the design of new 
systems: personnel hurhbers arid skill levels. 

The number of personnel required to operate and maintain a system is somewhat 
independent of the system's level of automation' because increased automation reduces 
operator needs, but increases maintenance requiremeRtS. System efficiency is achieved 
by judiciously trading off the degree of system automation with the skill levels operator 
and maihtehance personnel require to maintain the system in an operational state. 
Persdnnel characteristics required to operate the system at a criterion ievel of perform- 
ance may differ substantially from those required to maintain and support the system. 
Therefore, more efficient demands on the^Navy*s personnel resources can be made by 
making rnore effective trade-offs during the design of the system. 

If skill is considered as a commodity obtained by applying a process--traihirig^-tb a 

resoairce--aptitude — in return foe whatever investment is required^ then' skill rriay be 

- - - - - - * - - - - - - 

regarded'as capital (Schultz, I96I) that* can be ^aded Against the other, less abstract 

_ _ . _ • . . _ _ _ • . . 

forms of capital employed in system development. filodels to quantify skill in the 

economic sense (Tinbergen 5: Bos, 1962f; Davis <5c'Pihtb, 1575) will enable the designer to 

consider personnel skill simply as a rriUltidimensibhal equipment parameter if a functional 

relationship can be establishediietween system attributes and required personnel skills. 

The irripbrtahce of personnel skills to overall system effectiveness is presentij^ 

' i s ; . _ 

deceiving ^c^Dhsiderable attention in system design and development, ^because the acquisi- 
tion, develbpment, and retention of human resources-contribute greatly to the system life 
cycle costs. Yet, as emphasized by Lintz, Loy, Hopper, and Potempa (1973); personnel 



requirements are often introduced late — or not at all-- into the system desigp and 
development process, for various reasons: / 

1. Lack pf effectively quantified data for early in the design trade-off stages 
of system development. - ^ 

2* Lack of a convenient vehicle for delivering these d^ta to the user in a readily 
usable f orrh. ""^^ 

3. The limited cbrhmuhicatibhs between the many specialists involved in making 
system decisibhs. 

The pbiht at wWch inputs regarding persbhhel skill are introduced ihtb systerri design 
. is critical. Askren (1973) reported that theopreferred point of entry is during the period in 
which system design trade-off decisibhs are made. This period is alsb a gbbd time for 
effective cbni<rnuhicatibhs between the^illgiheerihg arid hurnah factbrs specialists. 

Three interrelated problems appear to be respbhsible for personnel skills ihformatibh 
being ignored so often. First, definitions of skill are vague and incohsistent. Second, the 
data are ungear and difficult to translate into engineering or design requirements. The 
third, and most important, problem is the lack of concrete personnel skill data applicable' 
to the design and development of Navy systems. 
Objective . . ■> 

The objective of this effort was to determine how hardware design engineers perceive 
the relationsliLps between system design charac^teristics and skills of system operator and 
maintenance personnel. . ' 

APPROACH ■ . ' 

s ■ : ' • ' ' ' ' 

_ __ _____ ' _ -s . 

studies conducted by the human resources research community were reviewed. As 
the literature search progressed^ it became evident that four apparently disparate 
research areas were in fact directly related to the areas being addressed: ; • ' 

1. Research conducted by^the lAir Fbrce and other agencies on the design process\ 
and the inf ormation heeds of desigh persbhhel. , ■ 



2. Research describing job performance; 

3; Research condacted on the analysis and measarement of skills; 

4. Research regarding- the presentation of human resbu^ irifbrrriatiori; 



LITERATURE SEi^RGH^. ' , - ' 

. f ' . ■ , , ■ , ■ -. ■ ' 

Impact of Human Factors Data on Designs and Designers : : * ^ 

.: Meister,' Sullivan, and Askren (I95S) found that "manpower qUajitity arid personnel 
skill constraint data impact the equiponent configuration." This finding, wHich^ was based 
bri detailed case studies of the design process presented to. a riUmber, of skilled erigirieers^ 
supportec^ previous research regarding irifbrrriatibri Utilization arid the " desigri pirocess 
conducted by Meister arid his associates (e.g.^ Meister & Farr, 1967; Meister & Sullivari^ 
1967)^ arid ^others (e.g.^ Eastrinari^ 1968? Forsythe^ 1969).'^ Iri a 'fblldw-bri study, Meister^ 
Sullivan, Firiley, arid Askreri (1969a) loUrid that "the ambUrit .and timing of human 
resources data inputs do exercise some influence on the engineers' design." They went on 



to state that the "type of requirement imposed (skill level versus quantity constraints) 

made avdifference to the engineers.^ Building upon the results of the previously cited 
■ / . 

study, Meister, Sullivan, Finley, and Askren {1969b) examined the concepts of manpower 
and its : component parts ' (skill, number of people, experience, etc.) as they related to 
system/equipment design of the same group of engineers. In their sammary, they state 
that: ^ 



The engineer relates a riunnber of design concepts and character- 
; ' istics such as test poirits, internal con*:poriertts, checkout and trouble- 

shooting procedures, and type of test equipment reqilired:tb the skill 
level of the nncun-teriance_techriiciari. ... The engiNeer's cbricept of 
skill_ level_^ is^ Ttibre_ perTbrmance-briented thari that described by 
Air Fbrce Specialty Code desigriators. - 

Askreri arid his assbciates concluded that eri^^ineers arid rriariagers resist cbhsideririg 

riiari^ with his varibus attributes and costs^ as a-luirdvvare desigri cbristrairit (Askren, 1976). 

The hypbthesis was estarblished that maripb\ver-.related factors wbuld be accep^ble to, 

engineers arid- mariagemerit as a "Icebreaker wheri all erigirieering factors age' eqUal" 



.(Askren, 1976). For this concept to becbrtie operational^ the design pr'ocess itself had to 

. _ . . _ _ ..... ... I 

be exarnined, and a new way of influencing thqf de^sigh process established. This gave rise. 

to tine series of studies by Askren and his associates begun in 1970 (e.g., Lint5;<' Askrenj .& 

totti 1971; Askren & Korkan, 197i; Askren, Korkan, 5c Watts, 1973; and Whalen & Askren^ 

tiTttz et ai. (1971) found a negative, correlation (-.32) between utilization of* human 
resources (HR) dafa by d^ign engineers and experience (see Askren, 1973). They also 

s 

found that- HR data related to costs and numbers were considered almost three times 
more valuable than data related to *'skilj. type" or personnel availability (see also Whalen & 
Askren, 197^). In their conclusions, ttntz et al. (1971) state that design engineers will 



include RR data in engineering design trade studies and'^th^t the trade-off process is very 
much dependent on the perspr^al style and judgments of the engineer'' (Whalen & Askren, 
L97^). ' 

In a summ^i^i,^ work sponsored by the Air Force between 196S and 1973,' Askren 
(1973) stated that, before HR data could be effective, it would be necessary to provide 
data to the ehgli^eer regat'ding the effect on man of "choice point alternatives*' in the 
^ system design process. Askren Lintz (1975) contradicted this statem^ent in their 
conclusidns Tegardihg the same work.\ Their engineer subjects did not agree on the value 
<>f any trade-off study *parameter^ including HR data . None of their subjects ever 
requested HR data for use in solving the prbblems presented. Finally^ ho distinct impact 

'_>;.__. . ... ^ . . V . : 

■^for incorporating HR data could be determified. • . ^ " . 

Whalen and AsSren (1974) attempted to identify and classify those aspects of the 
design trade study process that have^*'high potential impact on human resource require-- 
.ments." They generated the hypothesis that, "the greater the technological disparity 
betweerr trade study design alternatives, the greater will be- the potential impact of the 
design decision on human resource requirements." When engineers were asked to judge 
the "technological disparity" in trade studies that had already been judged to be "high" or 
"low" in their impact on human resources, tfns hypothesis was supported. ' 



Iff a related study/ AskFeri ^hd his associates explored methods for 'describing and 
influencing the design process. Askreh arid Kbrkah (1971) conducted an extensive review 
and analysis of the literature related to the description t)f human dj^cision ^processes, and 
developed the design bptibh decisior^ tree (DObf) concept as a means to predetermine the. 

_. r _ _- 

des^gri options available to the engineer as. he progresses through a design problem. The 



ratibhale was that, to the extent ttiat design decisions could be determined in advance, 

: _ r,:, : _ ' . 

the relevant types of data could be acquired and pi'esented. to the engineer before he 



made his decisions. The DODT was tried as a "graphic means of depicting the sequence of 

engiheering decisions re<juired fbr/^esolation of a design problem," and was judged by eight 

J ' » 

engin^rijig subjects to be a "feasible and valid method for anticipating- and describing 

system design trade-offs" (Askren 3c Korkan, 1971). - 

Subsequently, .Askren Bpd his associates set out to "explore the feasibility of 

develop>ing design option decision trees to a level of detail that shows hardware involved 

in maintenance-operations, and to measure the sensitivity of diffSrerit types of hurfiah 

resources data to^diff erent design trade-off' problems depicted in these trees" (Askren <5c 

Korkan, T97^). In summarizing the results of that effort^ Askren (1976^^5^ 

it was found that DODTs can be developed, to the maihtenahce level 
> of detail. It was aJso found that the factors bf training and 
experience, amount of rSaihtehahce time^ and ease bf rriaihtenahce 
. were rrjost affected by Choice bf design bptibhs in the ,trade-bff 
problems. . - 

WKalen and Askren (197*), Pbtter^^Kbrkah, and. Dieterly (1975b),' and Potempa, Lintz; 

and Luckew (1975) all explored means for deterfriinihg the impact of design decisions on 

various HR parameters. Potter^ Kbrkah arid Dieterly (1975a) cpnclucfed that no satisfac- 

tor y 'technique for rrieasuring the impact bf projected technological developments on HR 

was available. However* in a summary of the Whalen and Askre^n (197^^) study, Asken 

(197S) fbUhd that: ' ^ - , - J 



(Air Force Tnaintenance technicia.ns) ca,n make reasonably accurate 
i estimates of the amount of time, the Air-J^or.ce occupational special- 
ty, the_level^of techmc^ and the number of personnel needed to 
perform fietS maintenance tasks. ^ 



these cdnclusidhS are lodsely supported by the original study. Poterr^ai^ ah (1975) 

: i • ■__ - \ - 

'developed some models that correlate system/equipment design characteristics and 

' . _ _ : .__ : :^ 

certain personnel characteristics (e.g., aptitude, education, etc.) -wnh perf prmance daring 
thti training course andron'the ^jpb. The inputs to these models were the jcrdgrnents; 
ratings, and rankings by students and instructors for tneining coarse performance, and 
those of maintenance supervisors for Job performartSe. They concidded that HR data 
couid be used alone to predict school performance, and that HR data (including sdhool 
performance) and maintenance-related design; characteristics could be used to predict job 
performance. AH of these studies have, however, attack^ the ^roblern frorri the same 
viewpoint, and none give enough , information about the irhpact of the technological 
aspects of a design on the man portion of a man-machine system, or the design engineer 
liimself and his- modes of operation. What Askren and his associates appear to have done 

- - - --■ • - ' -V-: , . - 

is to develop certain methods and techniques for describing the design process (e.g.j the 
DODT). Th^y also developed rriethbds for acquiring certain l<ih8s:of'HR data related to 

maintenance from personnel who mairitairi existing, system's/equipment with functional 

. .• . . ^ ■ . » ■ . ' ' . 

• charact^tristics similar tb^thbse of the system being designed. 

The first of these methods is predicated,dn the view that design is a logical, decision- 
making pybcess in which the designer "methodically** makes a series of design choices 
(Askren, 1976). Jhe second,- which'foliows from the first, is that the data for the decision 
process mUst be gathered in a manner that is responsive to the specific alternatives at 
each decision pdint. Inherent to this concept is the model of the sapplier of HR data as an 
Vniotn^ ally of the designer, or even as an active p'articipating member af the design 
team. Thi^ contept, which the authors wholeheartedly'sapport, is all too rare. 

Another concept of the design process is that, with all of the pressures, con5traints^^ 
and technologic&l problems that rnast be resolved . in the press of conceptualizing, 
designing, docarnentingf and selling systems/equipment, those system aspects dealing with 
man are given rather low priority. In the studies by Meister and his associates (1968, 
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1969a & 1969W, Lihtz al/(1971), arid Askreri arid Liritz (1975), HR-type data are 

cdrisisteritly rariked as less [iriripbrtarit than, data related to "harder" aspects of the 

system/equipriierit design. . Thfece _are probably hriany reasons for this lack of concern for 

the personnel who operate and maintain the systems. There are strong indications; 

however, that one reason is the inability of HR specialists to select and present 

irifbrrtlatibn to meet .the input requirements of the engineers who have differing education 

and experience. Askren (1976) asked the question: "Which process (approach to design) 

will a given engineer follow, for a given design?" He answered.by stating: : 

The answer seems dependent on a number of factors such as the 
trai-ning of the engineer, his personal style, the nature of the design 
problem, 'the tirri'e available to complete the design task, and com- 
pany and management design philosophy. 

The previously cited studies (e.g., Meister et al., 1967-1970; Askren & Korkari, 1971, 

1974; tintz et al., 1971; Lintz, Lay, Brock, & Potempa, 1973) have led to several attempts 

to develop and format human factors (HF) and HR data into handbooks (Devoe^^ 1963; 

Meister & Saliivan, 1969; Parker & West, 1973; Reed, Sriyder, Baran, Loy, <5c Curtin, 1975; 

VanGott & Kinkade, 1972; Woodson, 1954, 19^. The fact that these efforts have not 

induced engineers to ase HR data in their designs is attributable to several prominent 

factors. In the series of studies conducted for the Air Force's Human Resources 

Laboratory (reviewed in Askren, 1976), it was found that: - 

1. Erigineers respbrided primarily to desigri iripUts presented as specific -design 
requireriierits. ' . ' 

2. Engineers will respond to manpower qUaritity skill level data presented in an 
Understandable manner. / ^ 

3. Data presented as design requirements had a stronge^- impact upon design 
engineer acceptance and subsequent performance than did data presented its inforrnationj 

'r. Certain maintenancb design characteristics are perceived by design engineers as 

being more strongly affected by the siafl level of maintenance fpersonnci thnrirdre btliers. .. 

^ /•■..■ 

< ^ 

5, Engineers and design mariagers wore most likely to include I IF or | jR data as 
systein inptits durliig design tradeoff studies. At that tiihe, information related td 

7 13 ' ^ 



persdhhcl costs arid maripxDwer quantities was given more ^'weight" than was that related 

skill tj^es, skill levels, or personnel availability. 

The irieffectiveness of previgus attempts to present personnel skill data and related 

riiaripower iriformatiori to design engineers must be tied to two deficiencies of the HR 

data bases themselves: (1) skill is a rel^ively inexact concept in the behavioral sciences 

— - i ' -, - - 

arid (2) there are almost no data regarding the'engineers' concept of skill. 

Alterriative Approaches to the Bescription/Befiriitiori of Personnel Skill 

Fleishman's (1967) defiriition of skill as "the level of proficiency on a specific task or 

iimited group of tasks" was used as a basis for this research effort because it is more 

closely related to the operational uses of the term than are those definitions that limit 

skill to psychbrpqter abilities (e.g., Dunnette, 1976). Skill must be considered in light of 

work performance (bperatibhs or rnairiteriahce) withiri the orgariizationai environmerit 

. * ^ _____ 

provided by the Navy's missions. 

Researchers interested in human learning have exerted sigriificant efforts and tiriie to 

understanding the nature of intelligence and other human abilities related to perforriiarice 

during learning and work, these efforts have produced ah ehbrriibus vbluriie of tests of 

"different" human abilities. (See Finley, Obermayer, Bertbrie, Meister, & Muckler, 1970, 

for a discussion of this research.) . ^ 

In any type of^research, including that involving thje classificatiori/ahalysis bf hUrriah / 

performance, investigators are prone to use taxonomic schemes. Taxonomies are Usually 

developed' by seiectirig and labeling instances of ■ a class of objects or^behavibrs and 

arrarrging them accordinj^ to various simiiiarities arid differences between their. individual 

.._._: .__ _.__■___' • ■__.__:_.__•____ _^._...,__-^^-_;^."_._- :_• • :.-._Tv ■■: 

properties or attributes. The most crucial problem in taxonomy development, of course,: : 

is the actual choice of the attributes forming the basis of the Classification scherne. 

Fleishrnari (1975) viewed any ''system of classification as a tool to increase ability to 

interpret br predict some facet of hurriari performarice." He goes ori to state: 

We can elect tb develop a systcrii of classificatiori havirig utility for a 
lifriited area . . . , or we may look for a system from which a varfety 



of applications may stem; ; ; Where broad task classiftcatibri sys- 
tems are developed as autonomous structures, which are drily soriie 
time later to be applied to other variables, the classtficatibri exercise 
js an integral step in' the development of theory. The resultant 
system provides a consistent conceptual framework, the elements of 
which eventually are to be used in the* interpretation or prediction of 
human performance. 

Three interrelated approaches are available to describe arid select coricepts of skill or 
skill attributes that iriteract with equipment design: (1) an existing aptitude or#. trait 
system (e.g., Fleishman's set of psychomoter aptitudes), (2) task descriptive data (e.g.^ 
NOTAPS information), and (3) designers' own concepts of skills. Outcomes from any of 
these approaches must be related to their irhpacf ori specific dimensions of hardware arid 
system design. . 

M^ister and Mills (1970), in evaluating the alternative approaches available for the 

classification of humari perfbrrparice^ state: 

Previous taxbhbrhic practice has been to develop a a- fit4ot4 sic 
classif icatibh and to attempt to force-fit the behavioral phenomena 
into the existent ciassificatibn scheme. 



Four cbhceptual approaches to the description of tasks are described by Barret, 
Dambrot, and Smith (1975), and Fleishman (1973): 



L In the behavioral description approach, tasks categories are based on observa- 
tions and descriptions of what individuals actually do while performing a task. The 
Position Analysis Questionnaire , wherein job and task performance are observed and rated 
by trained observers, is an example of this approach (McGormick, 3eanneret, & Mecharri, 
1972). 

2. In the behavioral requirements approach, those behaviors assumed to be required 
to perrorm given tasks are catalogued. Although a number of efforts have been directed 
toward identifying and codifying the intellectual and physical procc?sscs by which tasks get 
accomplished, these efforts generally have been used tb categorize behavior withbut any 

» __ ____ _v _ _ 

systematic effort at validation. The ratibhally established ciassificatibn systems develops 
eel by licrliricrj AnRcll, and Shearer (197^)* Miller (1976), and Christenseh arid Wills (1967) 



are examples of this approach. Barret and his associates (197^) found that the rationally 

/ " ' * ^ • 

formulated task taxoncraic systems developed by using this approach fluctuate between 

describing tasks and their behavioral anteoedents. They state that tl^s approach has "hot 

yielded a standarized classification system with wide 'generalization or integrative 

power." • ' . ; 

3. , The ability requirements approach is defined by'Fleishman (1975) as being similar 

in many respects to the behavioral requirements approach already described. He states 

that if^differs "primarily in terms of concept derivation and level of description." He ^es 

on to state that "the ability concepts are empirically derived through factor analytic ^ 

studies and are treated as more basic '^hits than the behavior functions." Fleishman 

expressed his belief that this approach can provide ah integrative framework for, 

understanding task performance under a variety of conditions. In a related effort, Barret 

et al. (1975) state that "task taxbnbrriies^ based dh th^ abilities approach, have been 

effective in laboratory settings. Findings have' hot been validated in field studies." 

Fleishman (1975) defined the task charH acteristics approach as "predicated on a 

definition that treats the task as a set of conditions that elicit performance. . . i Having 

adopted this point of view, appropriate descriptive tarms are^ those that focus on the task 

per se. The assumption is made that tasks can be described and differentiated in terms of 

ihtrihsic, objective properties they may possess." An example of this approach is the work 

of Farina and Wheaton (1971), which uses scalar ratings to relate task characteristics to 

ability requirements. 

In reviewing the utility of the various approaches to the classification/analysis of 
human performance, Meister (1971) states: "Indeed, tt is conceivable that ho universal 
taxonomy can be applied, because task descriptive needs vary from system to system." 
He further states: "The suitability of a task description depends bh the purpose for which 
it is being developed." 

Dtinnette (1975) concludes: . - - - 

16 

lb 



studies of aptttddes and skills on the one hand and work perfqrmance 

on -the other; have apparently yielded two quite distinct taxonomic 

worlds— one based mostly on standardized test responses; the other 

based mostly on the study and description of .actual work perform- ^ ^ \ ' 

ance. ' \ 

In seeking to link these two worldf, Dunnette suggests that the difference between them 

is based on (1) the level of molanty of the .classification systems employed, and (2) 

whether the classiiicatibn systems are empirical or inferential in nature. Re states: "So 

far^ ho .one has derived behavioral taxonomy midway between the world of work and the 

world of human attributes. measured via standardized tests and inventories." 

Such a taxonomy^ which would be 4 useful framework for studying the designers'' 

concept of 'skill, Uhfdrtunately^ ddi^s hot exist. However^ the research does exist to 

suggest a method for achieving the goals of this study. If the desigh ehgiheers* concepts 

of the term skill and its compdh^hts, and the .relationship betweeh* these cdhcepts and 

various aspects of hardware design can *be ^llihed, pnen it should be possible td Ideate 

data on those concepts that engineers could use in the design process. Based dh the 

literature reviewed herein, it appears that a combination of the last three apprdaches 

would be most favorable to the objectives of this research effort. 

A revie\y of the previous research related to engineers' understanding and use of HF 

or HR data in the analysis^ development, and establishment of system/equipment design 

(e.g., Meister et al., 1967-1969^ Jleed et al., 1975; tintz et ai., 1971; Meister, ; l.S[76) 

reveals that the methods employed have been of three types. First, in the structured 

desigh exercise^ or simulatidh^ a de^igh proSlem derived or selected by the researcher was 

presented to the individual ehgiheer fdr solution. The major variables in these studies 

(e.g., Meister & Sullivan, 1967; Meister et al.^ 1968; Eastman, 1968; Lintz et al., 1971) 

were type and the presence (or absence) of HF or HR data made available to the engineer 

subjects. . 

in the second method, engineer subjects were presented with selected types df HF dr 
Hi^ data; Typically^ this information had been extracted from existing HF^STHR data 



dbcumematibn (see Meister & Farr, 1967; Rogers & Arfristrbrig, 1977; Rogers & Pegderi, 
1977) or from proposed formulations of this type of informatibri (see Meister 3c Sullivarij 

_ _ • ^ i_ • - - ' • - _ 1 " - -■ 

;1969; Meister, 1976), The variables in studies using this method were the types 'of 
information provided and the means by which they were presented to the user. Usually 
measure'rnefit consisted of assessing the users* preferences for alternative formats, arid 
their ability to extract the "correct" information from the .vat|ous types of data ; 
presentations. , * . . 

In^ the third method, various groups, of "expert^" were asfced about the importance of ^ 
^ certain human-engirieering or HR factors oh system ^design or dperatidh (see Whalen & 

Askren, 197^; Blanchard, 1975; Potempa et al."^ 1975). The bulk of the efforts ^^mploying . 

i . \ .. ■ . . ^ . _ . . ' ..... 

«this method have been conducted for the Air Force by Askreri arid his associates. They 

, demonstrated that operational persbhhel (equipment operators and maintenance personnel) 

, 

can estimate the impact of certain types of systefn/equipment characteristics on the 

^_ _ « _ ■ _ __ _ _ ... ' _.» .__ 

numbers and types of personnel required (Potter et al., r975b;'" Potempa et al., 1975; 

Whalen 5: Askren^ 197^). They also showed that engineers have consistently limited their 

concepts of HF or HR data to those aspects that are important to their cpncepts of 

systerh/equipmeht operations or maintenance (Meister et al., 1969a, 1969b; Blanchard, 

1975; Meister, 1976).; In a separate area, McCormick and his associates (1972) employed 

the same method to assess the^extent to which job designers use HR-type data. 

)q ■ . . - _ . . • ■ ' • ' ' , 

Previous Desip;n Guide Research 

In summarizing his review of the Air Force's work bri the use of HR data in design, 

Askren (1976) makes several points related to the riatUre arid direction of the proposed 

effort. He states: - 

The- overriding finding thfeu^hbUt all of the research, has been the 
feasibility and practicality pf Usirig human resources data as criteria ' 
in enginefering design studies. QUahtiflcatib/1 of the data is possible. 
Engineers accept the data. \lhpUt points to the design process are • 
avaifable.. And the quality bf the human data is of ten as good as the , 
quality of the engineering data, especially in early copceptual design 
studies. - , ' ^ ' : ' -'-^ - ; , 
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, A wicfe variety of hUniah resources data were found to be useful 
. . criteria in design studies, this included sUcH •factors as maripower 

' • . : quantity,' technician skill level, ^echhiciah job speciality^ personnel 

- dollar cost, type and amdUht of traihihg, taste pisrfbrmance^ time^ job 
• difficulty, and personriei turnover rate. The sixth study (AsPcreh et 
al.," 19^3) found that the type of data relevant to a particular design 
problem is a function of the ^nature of the design studies. It is 
: critical to provide the engineer with dat^ that is most relevant. 

• ........... J. i ---- -- ••- - ^ - - • - - 

These conclusions support the results .reported by Meister and Farr (1967), ,and 

J - __ _" ' __ . V ■ ■ . . 

^ Meister and,5uiiivan (i969a, 19695), and are expanded by the findings reported in Meister's 

1976 study, which assessed the effectiveness, utility, and acceptability of the prototype 

HR data handbook developed by Reed et al. (1975). Meister found that the development 

, and presentation of HF/F1R data to design engineering personnel produced the following 

cdheiusioris; * ^ • 

* ' a. " Systeni development persorihef.<^ use the prototype h^a^nd^ 

to make significantly more correct decisions than without the hand- 
book. Engineers have greater confidence in decisions: mad^ with the 
prototype handbook than witHout it, , ^ . . * . 

. b. If one considers that a substantial percentage of participants 

viewed the protbtype handbook as having utility and potential influ- 
ence on design^ the audience for this handbook is potentially large. 
Engineers hadj some difficulty re^^^ 

which the prototyp,e handbook was designed as bng^ they ordinarily 
ehcbUhtered, but cbhsidered thesf problems to be realistic. Engine-' 
. ■ ; ; - . ers cbnsid^r: Jheir^^b^ dat^^:spurces al^mpst as, good ^s the prototype 

' ... \ handbook,. but ^mljclf'lesl ac^ . ' i- ^ v . ^ 

c. Those who saw utility in the prototype handbook and are hence 

more likely to use it. are rhbre HKj|ly to have speciali2|d jbbs (e.g», - - *. 
hunnafi factors,, maintainabirity, crew station design) than general 
design functions. Thpse whov^^^ of the, type 

df alt w^ith by the proto '. 
that handbook and are therefore mjorejikely to Uselit.. 

d. A number of improvements Jvere recommended by asse^^merit * * 

^. participants, inpluding updating the data^ simplifying the Master "^' . 

. ■ Index systerrt, reducing verbiage, in the tables , and clarify ' 

> ' implications of the protbtype handbook data^ 'These improvenr^nts 

are required to make^he prototype .hancfbook ma^^^ "''^ -■. / ' 

. ' . . ■■ ' ' f;:- ' *■ 

. ; to warrant contiryjing ef^ . ' - . , 

■rA; ' y 'forts to develop handbooks and/or data banks of HR data. for use in 

. the design of new systems and equipmerrts; . : \ 

Rogers and Armstrong (1977), in a study examining Xhe use of human engineering: 
standards (the. most- eommdh of eici^t^ for* transmitting JHF/HR informatibn to 

o^"- ■' ,.v.^v-^:;-;- ; ...■,>-i 13 ' ■ 19.'. 
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designers), concluded that: ""Existing standards appear to have little effect bh product 

design," This, aujhcff^ then went on to suggest that human ^ngtneering/HF standards could 

be enhanced if tfie following suggestions were adopted: ■ , . ' 

^ i. Eliminate the use of such, terms as "whenever pSssible," 
• ,"propfer feel," Vhighjtorque," which are general in nature br ambigu- 
" ous. If the requirement ' cannot be expressed in 'quantitative or more 

exacting terminology, do not ^ include it or define : it as only a 

guideline. • 

' 2. Present quantitative data in a manner cbasisteht with^^ 
designer preference (i.e., graphical br pictorial means first, followed 
. by tabulatidns). t 

3. Eliminate_incohsistericies in ddta within standards and be- 
tween standards. The between standards differences could be reduc- ^ 
ed by the incorporation of all' gbyerhmerit-sporisbred human^factors 
standards into one single standard with applicable sections to cover 
j ' individual agency needs. ' ' 

fi'. Prbvide revisions arid Updatirig of standards in a more timely 
mannerf to make curferit iriformatibri available to the user. With the . . 
rapidly changing techriblbgy^ yearly revisions would seem more apjprp- 
priate than the two- to fbUr-^year revision cycle of the past. 

* * • . _ __1 

These suggestibri^ are probably just as relevant ^to the development of the proposed 

desigris as tb the staridards that were the subj-ect of the cited study. 

A parallel study (Rogers & Pegden, 1977), which involved a detailed analysis of two. 
existing gbvernment human engineering standards and the results of a survey of 65 
designers and human engineering specialists, identified the major formatting and organi- 
zational problems that reduced the effectiveness of these standards: 

1. Content. . • 
. 2. tack of graphic presentations. } . 

3. back of adequate indexiTig systerns^ i ^ 

4. tack of clearly defined commbri terms. 

these same problems 'had been identified earlier (Meister & Farr, 1967; Weister & 
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Suflivan)^ 1968),; and attempts were made tb remedy them in documents develbpetf by 

_ > ■ ' _______ _ ' _ / _ _ _ * _ 

Meister and Sullivan -('1969) and Reed et al. ;(1975). In both of these efforts, some 

attempts were made to ideritify the target audierifce for which' these guides should be 



developed; Although these efforts were largely tahsuccessful^ H was reebgnized that all 
system design .personnel do hot need the same HR data^ arid that, they do riot share the 
sameinforrfiation acquisition, storage, and retrieval organize 

' CONCLUSIONS ^ . ; - 

The magnitude of the prbblerr^' of cbmrriuriicatirig HR data to design ehgiheers iS^weU 
. . recognized/ but its sblutibh is ribt clearly definable. Also, the types of data required for 
cbmrhUhicatirig hUrriah resources ihfbrmatlbn to ehgiheers are not readily- identifiable, 
t The f ollowihg questions rerhaih to answered: 

1. Who will be the primary users §f HR information? If they are the behavioral 
specialists who translate these data for other system development personnel, the audience 
for the information is small and highly specialized. If they are other system development 
personnel who use the information to translate the behavioral inputs" directly into" 
engineering terms, what is the role of the human factors specialist in systems develop- 
merit? Should the iriformatiori be addressed to both types at audienc^^ Is it possible to 
present data for two such different user groups in the same format? . 

2. Is there a subset of systemi develdpriient personnel (e.g., engineering specialties,, 
such as fnaintainance, cre\y system design, etc.) other than human factors -specialists, to 
whom this type of iriformation should be specifically directed? How broad should the 
targeted audience for this irifbrrriatibri be? 

. 3. What kind bf r^actibri signifies that thg intend^ audience will in fact rriake use 

of this information? What does the developer expect the User to do with this kind bf 
infbrrriatibh? ; 

ff. What is the intended scope of the data to be presented? Although numerous data 
bases, hundreds bf publications, and perhaps thousands of journal articles are available, 
much of this data are too vague and imprecise to be of value during the Idesign engineering 
process. * ■ - , 

I. • 
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. RECbMMENDATldNS 

i/- In defining ihe techniques needed to communicate HR data to desigo engineers^ 
research shbald be directed toward developing a better understandmg of how engineers 
"perceive the relationship bet>X^een design characteristics and resulting skills implications. - 
2. Specific operatibrial definitions of sl<ills • applicable to Navy ratings arid pay 
grades operating and rriaintaihihg hardware systerris should be developed. Such operational 
• defihltibhs shbulcl be in. terms and fbritiats readily uhderstahdable to arid directly usable by 
the hardware designers. 
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